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DESCRIPTION 

Field of the invention 

The present Invention relates to a server Intended for generating, from an Input 
transport stream of a first type and from data of a second type, an output stream of said first 
type which notably carries said data of said second type. More specifically the invention relates 
5 to a server intended for generating from an Input MPEG-2 transport stream and from MPEG-4 
data, an output MPEG-2 transport stream which notably carries said MPEG-4 data. 

The invention also relates to a method for generating, from an input transport stream of 
a first type and from data of a second type, an output transport stream of said first type which 
notably carries said data of said second type. 
10 The invention further relates to a broadcasting system comprising such a server, and to 

a computer program for implementing such a method. 

Backoround of the invention 

It is known to transport data of a second type in a transport stream of a first type. For 
15 example, the transport of MPE64 data over MPEG2 systems Is described in the standardization 
document ISO/IEC JTC1/SC29/WG11/N3050 published by the ISO in January 2000 under the 
tide ''Information Technology - Generic Coding of Moving Pictures and Audio: Systenns; 
Amendment 7: Transport of ISO/IEC 14496 data over ISO/IEC 13818-1". 

20 Summary of the invention 

One of the object of the invention is to propose an advantageous way of generating said 
output transport stream. This is achieved with a server as described in the opening paragraph, 
said server having: 

- first means for generating an intemnediate transport stream by creating available bandwidth in 
25 said input transport stream, 

- second means for inserting said data of said second type in the available bandwidth of said 
intermediate transport stream, thereby generating said output transport stream. 

One advantage of the invention is that it avoids a complete demultiplexing of the Input 
stream thereby reducing the computing cost of the proposed functionality. 
30 In an important embodiment of the invention, particularly suited for MPEG-2 / MPEG-4 

applications, the Input transport stream carries controlling information and the server has third 
means, upstream said second means, for updating said controlling information to take into 
account said data of said second type. 

When the bit rate of the transport stream shall not be increased, the available 
35 bandwidth is advantageously created as indicated in claim 2 of the present patent application. 

When the bit rate of the transport stream shall be increased, the available bandwidth is 
advantageously created as indicated in claim 3 of the present patent application. 
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These and other aspects of the Invention will be apparent from and elucidated with 
reference to the description and the drawings hereinafter. 



Brief description of the drawing 
5 - figure 1 is a schematic representation of a broadcasting system according to the invention; 

- figure 2 is a functional diagram showing the operations to be executed by the server in order 
to generate the output transport stream; 

- figure 3 is a schematic representation of the operation of bandwidth creation in a first 
embodiment of the invention, 

10 - figure 4 is a functional diagram describing the operation of bandwidth creatiop in a second 
embodiment of the invention. 



Descripta'on of preferred embodiment 

In all the description the transport: streams of the first type are MPEG-2 transport 
15 streams and the data of the second type are MPEG-4 data. This is not restrictive. 

Figure 1 gives a schematic representation of a broadcasting system according to the 
invention. This broadcasting system comprises a server 1 intended for generating from an input 
MPEG-2 transport stream TSin, and from MPEG-4 data M4, an output MPEG-2 transport stream 
TSout which notably carries the data M4. The broadcasting system also comprises a terminal 
20 equipment 2 comprising a demultiplexing unit 21, an MPEG-4 engine 22, and an MPEG-2 

audio/video decoder 23, in order to retrieve MPEG-2 and MPEG-4 data in view of use by a client 
application 24. 

According to the MPEG-2 standard, system information are transmitted in the form of 
tables called PSI tables (PSI stands for Program System Information). These tables constitute 

25 the controlling Information of the invention. Their function is to indicate how the stream is 
constituted: it may be constituted of one or more elementary video stream, one or more 
elementary audio stream, and of MPEG-4 data streams. In the transport: stream, all data (MPEG- 
2 video, MPEG-2 audio, and MPEG-4 data) are interleaved. The PSI tables are used at the 
reception to reconstitute the programs. 

30 Figure 2 gives a representation in blocks of the operation to be executed by the server 1 

in order to generate the output transport stream TSout According to figure 2, the input 
transport stream TSin is delivered to a bandwidth creation block Bl. The bandwidth creation 
block Bl generates an intermediate transport: stream TSm having available bandwidth. The 
intermediate transport stream TSm is delivered to an updating block B2. The function of the 

35 updating block B2 is to update the PSI tables carried is the intenmediate transport stream TSm 
in order to take into account the presence of the data M4. After updating, the intermediate 
transport stream TSm is delivered to an insertion block B3. The insertjon block 83 also receives 
the data M4. Its function is to insert the data M4 In the available bandwidth of the intermediate 
transport stream TSm. 
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It is to be noted that MPEG-4 data may comprise audio and video data but also Scene 
descriptions and Object descriptions. In the case where the data M4 contain Scene and Object 
descriptions it is necessary, in order to comply with the Amendment 7 of the MPEG-2 standard, 
that the data M4 go through a synchronization layer and optionally a Flex/Mux layer before 
5 being delivered to the updating block 82 and to the insertion block B3. The function of the 
synchronization layer is to provide timing, synchronization, fragmentation and random access 
information relating to the elementary MPEG-4 streams. The function of the Rex/Mux layer is to 
interieave the MPEG-4 data originating from multiple MPEG-4 data streams. To achieve this, the 
server 1 optionally comprises a synchronization block B4 and a Flex/Mux block B5 which process 
10 the data M4 before delivering them to the updating block B2 and to the insertion block 83. 
Blocks B4 and 85 are represented in dotted lines in figure 2, 

The way in which the PSI tables have to be modified to take into account the presence 
of MPEG-4 data in the MPEG-2 transport stream is defined in the Amendment 7 of the MPEG-2 
standard. 

15 In practice, MPEG-2 transport streams are made up MPEG-2 transport packets. The 

insertion block B3 comprises a mapping block B31 and a replacement block 832. The function of 
the mapping block 831 is to map the data M4 into MPEG-2 transport packets. The function of 
the replacement block 832 Is to replace the null transport packets of the intemnediate transport 
stream TSm with the transport packets containing the data M4. For example, the mapping 

20 operation is done as described in the international patent application W099/21337 applied by 
Koninklijke Philips Electronics N.V. 

The invention proposes two ways of creating available bandwidth depending on the 
ability to increase the bit rate of the transport stream. 

Figure 3 illustrates a first embodiment of the bandwidth creation block 81 when it is 

25 possible to increase the bit rate of the transport stream. In this example the input transport: 

stream TSin has a bit rate equal to R and comprises MPEG-2 video transport packets V, MPEG-2 
audio transport packets A and null packets N. Two null transport packets N represented in 
hatched lines are inserted after each transport packet of the input transport stream TSin. In this 
example, the resulting intermediate transport stream TSm has a bit rate equal to 3R. In figure 3 

30 the t axis represents the time. 

Figure 4 illustrates a second embodiment of the bandwidth creation block 81 when it is 
not possible to increase the bit rate of the transport stream. In this embodiment, the bandwidth 
creation block 81 comprises a demultiplexing block Bll, a transcoding block 812, and a 
remultiplexing block 813. The demultiplexing block Bll receives the input transport stream TSin. 

35 Its function is to demultiplex one or more elementary video stream(s) carried in the input 

transport stream TSin. To achieve this the demultiplexing block Bll comprises a video packets 
extraction block Bill and a transport layer removing block B112. The function of block 8111 is 
to extract the transport packets corresponding to said video elementary stream(s) from the 
input transport stream TSin. The function of block 8112 is to remove the transport layer in order 
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to retrieve the video data. The retrieved video data are delivered to the transcoding block B12. 
The function of the transcoding block B12 Is to decode and re^encode the video data with a 
lower accuracy in order to reduce the bandwidth they occupy. The re-encoded data are 
delivered to the remultiplexing block B13. The remultiplexing block B13 comprises a mapping 
block B131 and a replacement block B132. The function of the mapping block B131 is to map 
the re-encoded video data into MPEG-2 transport packets. The function of the replacement block 
B132 is to replace the extracted video transport packets with the. transport packets containing 
the re-encoded video data and null transport packets N. In this example, the replacement block 
B132 delivers an intermediate transport stream T5m which rate is equal to the bit rate of the 
input transport stream. 

Coming back to figure 2 it is to be noted that the data M4 to be introduced in the MPEG- 
2 transport stream may be stored locally on the server 1. They may also be transmitted from 
another remote server, for example over an IP link. 
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1. A server intended for generating, from an input transport stream of a first type and from 
data of a second type, an output transport stream of said first type which notably carries said 
data of said second type, said server having: 

- first means for generating an intermediate transport stream by creating available bandwidth In 
5 said input transport stream, 

- second means for inserting said data of said second type in the available bandwidth of said 
intermediate transport stream, thereby generating said output transport stream. 



2. A sender as claimed in claim 1, wherein said input transport stream carries controlling 
10 information, and said server has third means, upstream said second means, for updating said 
controlling information to take into account said data of said second type. 



3. A server as claimed in one of claims 1 or 2 wherein said streams of the first type are 
composed of transport packets, and the creation of available bandwidth is made by insertion of 

15 null packets in the input transport stream, so that said intermediate transport stream has a 
higher bit rate than said input transport stream. 

4. A server as claimed in one of claims 1 or 2 wherein said transport streams of the first type 
are composed of transport packets, said input transport stream carries a plurality of elementary 

20 Streams containing encoded data, and the creation of available bandwidth is made by: 

- selecting one or more elementary stream(s) in said input transport stream, 

- demultiplexing the selected elementary stream(s), 

- transcoding the encoded data contained in the demultiplexed elementary stream(s) in order to 
reduce the bit rate they occupy 

25 - and remultiplexing said transcoded data while inserting null transport packets in such a way 
that the generated intermediate transport stream has a bit rate which is smaller or equal to the 
bit rate of sard input transport stream. 

5. A broadcasting system comprising at least a server as claimed in one of claims 1 or 2 and a 
30 client terminal intended to receive the output transport stream delivered by said server and to 

retrieve the data carried in this transport stream in view of a use in a client application. 



6. A method for generating, from an input transport stream of a first and from data of a 
second type, an output transport stream of said first type which notably carries said data of said 
35 second type, said method having: 

- a first step for generating an intermediate transport stream by creating available bandwidth in 
said Input transport stream. 
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- a second step for inserting said data of said second type In the available bandwidth of said 
intermediate transport stream, thereby generating sard output transport stream. 



7. A method as claimed in claim 6 wherein said input transport stream carries controlling 
5 information and said method has a third step, upstream said second step, for updating said 
controlling infonnation to take into account said data of said second type. 

8- A method as claimed in one of claims 6 or 7 wherein said transport streams of the first type 
are composed of transport packets, and the creation of available bandwidth is made by insertion 
10 of null packets in the input transport stream, so that said intermediate transport stream has a 
higher bit rate than said input transport stream. 

9. A method as claimed in one of claims 6 or 7 wherein said transport streams of the first type 
are composed of transport packets, said input transport stream carries a plurality of elementary 

15 streams containing encoded data, and the creation of available bandwidth is made by: 

- selecting one or more elementar/ stream(s) in said input transport stream, 

- demultiplexing the selected elementary stream(s), 

- transcoding the encoded data contained in the demultiplexed elementary stream(s) in order to 
reduce the bit rate they occupy 

20 - and remultiplexing said transcoded data while inserting null transport packets in such a way 
that the generated intermediate transport stream has a bit rate which is smaller or equal to the 
bit rate of said input transport stream. 

10. A computer program having means for implementing a method as claimed in one of claims 6 
25 or 7. 
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ABSTRACT 



METHOD OF INSERTION OF DATA OF A SECOND TYPE IN AN INPUT STREAM OF A RRST TYPE 



The invention proposes a method for generating , from an input transport stream of a 
first type and from data of a second type, an output transport stream of said first type which 
notably carries said data of said second type. 
This method consists in: 
5 - generating an intenmediate transport stream by creating available bandwidth in the input 
transport stream, 

- inserting the data of the second type in the available bandwidth of the intermediate transport 
stream, thereby generating the output transport stream. 

The method notably applies to the generation of an MPEG-2 output transport stream 
10 from an MPEG-2 input transport stream and from MPEG-4 data. In this case an additional 
updating step is necessary to update PSI tables. 

Reference: figure 2. 
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